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DECOMPOSING NATUEIAL IMAGE SEQTJENCES 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This ^plication claims the benefit of U.S. Provisional Application No. 60/421,269, 
filed on October 25, 2002, v/hich is incorporated by reference herein, 

5 

BACKGROUND 

The present invention relates to representing and analyzing sequences of images of a 
natural scene. 

It has been proposed that natural images can be described in terms of intrinsic 
10 characteristics, such as range, orientation, reflectance, and incident illumination of the 
surface element visible at each point in the image. H.G. Barrow & J.M. Tenenbaum^ 
Recovering intrinsic scene characteristics from images^ in A. Hanson & E. Risemaxl^ editors. 
Computer Vision Systems, Academic Press (1978). The extraction of infomiation describing 
such characteristics is complicated, however, by the fact that the information representing the 
15 combined characteristics for each pixel in an image is confounded in a single pixel value 
representing the intensity of light captured for the coiresponding location. The 
decomposition of these pixel values to obtain information corresponding to intrinsic 
characteristics depends on the introduction of constraints derived from assumptions about the 
scene and the imaging process. 
20 In one approach to the problem of decomposing an image sequence including / 

images into constant reflectance and varying illumination such that: 
r=RV (1) 

the images /' are first transformed into the log domain where their compositions as 
component- wise products of reflectance and illumination are replaced by component-wise 
25 sums of coiresponding logged terms: 
i' ^r + r {2) 
where 2 ' , r , and V denote the logs of /' , , and r . 

Vertical and horizontal derivative filters/, and are then applied to /' : 
(3) 
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